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Abstract. We present a state-based regression function for planning domains where an 
agent does not have complete information and may have sensing actions. We consider bi- 
nary domains and employ a three- valued characterization of domains with sensing actions 
to define the regression function. We prove the soundness and completeness of our regres- 
sion formulation with respect to the definition of progression. More specifically, we show 
that (i) a plan obtained through regression for a planning problem is indeed a progression 
solution of that planning problem, and that (ii) for each plan found through progression, 
using regression one obtains that plan or an equivalent one. 



1. Introduction and Motivation 

An important aspect in reasoning about actions and characterizing the semantics of 
action description languages is to define a transition function that encodes the transition 
between states due to actions. This transition function is often viewed as a progression 
function in that it denotes the progression of the world by the execution of actions. The 
'opposite' or 'inverse' of progression is referred to as regression. 

Even for a simple case where we have only non-sensing actions and the progression 
transition function is deterministic, there are various formulations of regression. For exam- 
ple, let us consider the following. Let $ be the progression transition function from actions 
and states to states. I.e., intuitively, $(a,s) = s' means that if the action a is executed in 
the state s then the resulting state will be s'. One way to define a regression function ^'i is 
to define it with respect to states. In that case s € ^i{a,s') will mean that the state s' is 
reached if a is executed in s. Another way to define regression is with respect to formulas. 
In that case ^2(0; /) = 9, where / and g are formulas, means that if a is executed in a state 
satisfying g then a state satisfying / will be reached. 
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For planning using heuristic search, often a different formulation of regression is given. 
Typically, a planning problem is specified by a set of actions, an initial state, and a goal 
state, which is a conjunction of literals. As such, regression is often defined with respect to 
a set of literals and an action. In that case the conjunction of literals (the goal) denotes a 
set of states, one of which needs to be reached. This regression is slightly different from ^'2 
as the intention is to regress to another set of literals (not an arbitrary formula) , denoting 
a sub-goal. 

With respect to the planning language STRIPS j^, where each action a has an add 
list Add{a), a delete list Del{a), and a precondition list Prec{a), the progression function 
is defined as Progress{s,a) = s + Add{a) — Del{a); and the regression function is defined 
as Regress{conj, a) = conj + Prec{a) — Add{a), where conj is a set of atoms. Intuitively, 
Regress{conj, a) represents a minimal requirement on states from which the execution of 
a leads to states satisfying conj. The relation between these two, formally proven in |16j . 
shows the correctness of regression based planners; which, through use of heuristics (e.g. 
mo]); have done well in planning competitions. However, the focus of these papers has 
been the regression function in domains where agents have complete knowledge about the 
world. The following example shows that this property does not always holds. 

Example 1.1. Consider the following do-or-die story ^: 

A wannabe prince faces the last task in his endeavor. He stands in front of two 
rooms. In one room is a tiger and in the other is the princess, whom he wants to 
marry. Opening the room with the tiger will result in him being eaten. Otherwise, 
he will be able to rescue the princess and will get to marry her. He does not know 
exactly in which room the princess is. However, he can use a specialized^ smell 
sensor that can precisely tell him where the tiger is. 
The story can be formalized as follows. Let us denote the rooms by 1 and 2. in{t, R) 
(resp. in{p,R)) denotes that the tiger (resp. the princess) is in room R. Initially, the agent 
(i.e., the want-to-be prince) is alive; he does not know what is behind the door of each 
room (i.e., the truth value of in{t,R) and in{p,R) is unknown to him) but he knows that 
the tiger and the princess are in different rooms (i.e., if in{t, 1) is true then in{p, 2) is true, 
etc.); he can execute open(l) and open{2). Executing the action open{R), when in{t,R) 
is true, causes him to be death {-^alive); otherwise, the princess gets rescued. The agent 
can determine (by smelling) the truth value of m(t, 1) and in{t,2). If he dies, he can not 
execute any action. 

It is easy to see that the only possible way for the agent to achieve his goal is to begin 
by determining where the tiger is (by executing the action smell); after that, depending 
on where the tiger is, he can open the other room to rescue the princess. Observe that 
this plan involves the action smell whose execution does not change the world but changes 
the knowledge of the agent. Furthermore, the second action of the plan depends on the 
knowledge of the agent after the execution of the first action. We say that the agent needs 
a conditional plan with sensing actions to achieve his goal. 

Reasoning about the effects of actions and changes in the presence of sensing actions 
and incomplete information has been the topic of intensive research (e.g., |10 (ll2| [T3 l ll8 | 120] 

"'^This story was brought to us by a participant of a Texas Action Group (TAG) meeting at Lubbock in 
2002 during a discussion on the need of sensing actions in reasoning about actions and changes and planning. 

Because the rooms are too close to each other, the natural smelling ability of a human is not quite 
accurate. 
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and the discussion in these papers). In general, the progression function for action theories 
with sensing actions and incomplete information is defined as a mapping from pairs of 
actions and belief states to belief states, where each belief state is a set of possible states. 
Intuitively, a belief state represents the set of possible states an agent thinks he might be in 
given his knowledge about the world. For example, the initial belief state of the want-to-be- 
prince in Example 1 1 . 1 1 consists of every possible state of the world; and, after the execution 
of the action smell, his belief state consists of a single state in which he is alive and knows 
the location of the tiger and the princess. 

It has been also recognized that the planning problem in domains with sensing actions 
and incomplete information has a higher complexity than the planning problem in domains 
with complete information [T]. Furthermore, plans for achieving a goal in these domains 
will sometime require sensing actions and conditionals 10, SHI- It should be noted that 
there is an alternative approach to planning in the presence of incomplete information, 
called conformant planning, where no sensing action is used and a plan is a sequence of 
actions leading to the goal from every possible initial situation. Example 1 1 . 1 1 indicates that 
this is inadequate for many planning problems. In the past, several planners capable of 
generating conditional plans have been developed (e.g., [K| 111! 1^) in which some form of 
the progression function has been used. 

In this regards, two natural questions arise: 

• How to define a regression function in the presence of incomplete information and sensing 
actions? 

• What should be the result of the regression of a state or a formula over a conditional 
plan? and, how can it be computed? 

In the literature, we can find several proposals addressing the first question |19| I18[ 
IH} I2nj. among them only the proposal in 20 partly discusses the second one. Moreover, 
all previous regression functions with respect to domains with incomplete information and 
sensing actions are about regression of formulas. 

In this paper we are concerned with domains where the agent does not have complete 
information about the world, and may have sensing actions. For such domains, we define 
a regression function with respect to states. We then formally relate our definition of 
regression with the earlier notion of progression and show that planning using our regression 
function will not only give us correct plans but also will not miss plans. In summary the 
main contributions of our paper are: 

• A state-based regression function for STRIPS domains with sensing actions and incom- 
plete initial state; 

• An extended regression function that allows for the regression from a (goal) state over a 
conditional plan; and 

• A formal result showing the soundness and completeness of our regression function with 
respect to the progression function. 

The rest of this paper is organized as follows. First, we review the necessary background 
information for understanding the technical details of the paper. We then present the 
regression formulation (Section ISJ and prove its soundness and completeness with respect 
to the progression function (Section |1J). We relate our work to other work in regression in 
Section ISl and conclude in Sectional 
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2. Background 

In this section, we present our action and plan representation and its semantics. 

2.1. Action and Plan Representation. We employ a STRIPS-like action representa- 
tion (9j and represent a planning problem by a tuple P = {A, O, I, G) where ^4 is a finite 
set of fluents, O is a finite set of actions, and / and G are sets of fluent literals where a 
fluent literal is either a fluent f £ A (a.k.a. positive fluent literal) or its negation (a.k.a. 
negative fluent literal). Intuitively, / encodes what is known about the initial state and G 
encodes what is desired of a goal state. 

An action a G O is either a non-sensing action or a sensing action and is defined as 
follows: 

• A non-sensing action a is specified by an expression of the form 

action a :Pre Prca Add Adda :Del Dela 

where Prca is a set of fluent literals representing the precondition for a's execution, Adda 
and Dela are two disjoint sets of fluents representing the positive and negative effects of 
a, respectively; and 

• A sensing action a is specified by an expression of the form 

action a :Pre Prca :Sense Sensa 

where Prca is a set of fluent literals and SenSa is a subset of the fluents that do not appear 
in Prca, .i.e., Prca H ({-■/ | / G SenSa} U SenSa) = 0. As with non-sensing actions, a 
sensing action might only be executed under certain condition, which is represented by 
Prca- Intuitively, Prca is the condition under which a can be executed, and hence, needs 
to be known to be true before the execution of a. On the other hand, SenSa is the set 
of fluents that are unknown at the time of execution. For this reason, we require that 
none of the fluents in SenSa appear in PrCa- As an example of a sensing action with 
precondition, consider the action of looking into the refrigerator to determine whether 
there is some beer or not. This action requires that the refrigerator door is open and 
can be represented by the action look with the condition Preiook = {door_open} and 
Sensiook = {beer _in_f ridge} . 
The next example shows a simple domain in our representation. 

Example 2.1. Figure shows the actions of the "Getting to Evanston" domain from J7] 
in our representation. 

The first four rows of the tables describe different non-sensing actions (driving actions) 
with their corresponding preconditions and add- and delete-effects. Each action can be 
executed when the agent is at certain locations (the second column) and changes the location 
of the agent after its completion. For instance, goto-western-at-belmont can be executed if 
the agent is at-start; its effect is that the agent will be on- western and on-belmont (third 
column) and no longer at-start (fourth column). 

The last two rows represent two sensing actions, neither requires a precondition; one 
allows the agent to check for traffic condition ( check-traffic) and the other one ( check-on- 
western) allows for the agent to check whether it is ( on-belmont) or not. 

The notion of a plan in the presence of incomplete information and sensing actions 
has been extensively discussed in the literature ^lElEHSOl- In this paper, we consider 
conditional plans that are formally defined as follows. 
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Action Name 


:Pre 


:Add 


:Del 


goto-western-at-belmont 

take-belmont 

take-ashland 
take-western 


{at-start} 

{on-belmont, 

traffic-bad} 
{on-ashland} 
{-■traffic-bad, 
on- western} 


{on-western, 

on-bclmont} 
{on-ashland} 

{at-evanston} 
{at-evanston} 


{at-start} 
{on-western} 


Action Name 


:Pre 


: Sense 


check-traffic 
check-on-western 






{traffic-bad} 
{on-belmont} 



Figure 1: Actions of the "Getting to Evanston" domain. 



Definition 2.2 (Conditional Plan). 

• An empty sequence of actions, denoted by [ ], is a conditional plan. 

• If a is a non-sensing action, then a is a conditional plan. 

• If a is a sensing action and (^i, . . . , are mutually exclusive conjunctions of fluent literals 
and ci, . . . , Cn are conditional plans, then 

a; case{(pi ci, . . . ,(pn ^ Cn) 

is a conditional plan ^. 

• If a is a non-sensing action and c is a conditional plan, then a; c is a conditional plan. 

• Nothing else is a conditional plan. 

Intuitively, to execute a plan a; case{ipi ci, . . . ,(pn ^ c^), first a is executed, (piS are 
then evaluated. If one of ipi is true then is executed. If none of (pi is true then the plan 
fails. To execute a plan a; c, first a is executed then c is executed. 

Example 2.3 (Getting to Evanston). The following is a conditional plan: 

check-traffic; 
case{ 

traffic- bad — > 

goto-western-at-belmont; 
take-belmont; 
take-ashland 
-•traffic-bad —i- 

goto-western-at-belmont; 
take-western 

) 

2.2. The Progression Function. In the presence of incomplete information, the knowl- 
edge of an agent can be approximately captured by three disjoint sets of fluents: the set 
of fluents known to be true, false, and unknown to him, respectively. Thus, we represent 
the knowledge of an agent by a pair {T,F), called an approximate state (or a-state), where 

"^We often refer to this type of conditional plans as case plans . 
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TCyl and FQA are two disjoint sets of fluents. Intuitively, (T, F) represents the knowledge 
of an agent who knows that fluents in T (resp. F) are true (resp. false) and does not have 
any knowledge about fluents in A\{T U F). It can also be considered as the intersection of 
all belief states satisfying T U {-■/ | / G F}. 

Given a fluent /, we say that / is true (resp. false) in o" if / G T (resp. f G F). f 
(resp. -i/) holds in o" if / is true (resp. false) in a. f is known (resp. unknown) in a if 
/ G (T U F) (resp. / ^ (T U F)). A set L of fluent literals holds in an a-state a = {T,F) 
if every member of L holds in a. A set X of fluents is known in a if every fluent in X is 
known in a. An action a is executable in a if Prca holds in a. Furthermore, for two a-states 
cJi = (ri,Fi) and CT2 = (T2,F2): 

(1) We call (Tin(T2=(TinT2, FinF2) the intersection of cJi and a2- 

(2) We say cJi extends o"2, denoted by a2^cri if T2CT1 and F2CF1. ai\a2 denotes the set 
(Ti\r2)U(Fi\F2). 

(3) For a set of fluents X, we write X\{T,F) to denote X\(T[JF). To simplify the presen- 
tation, for a set of literals L, by and L~ we denote the set of fluents {/ | /gL, / is 
a fluent } and {/ | -i/gL, / is a fluent }. 

The transition function (for progression) is defined next. 

Definition 2.4 (Transition Function). For an a-state a = {T,F) and an action a, <I>(a, a) 
is defined as follows: 

• if a is not executable in a then <I>(a, a) = {-L}; 

• if a is executable in a and a is a non-sensing action then 

^>(a, a) = {{{T\ Dela) U Adda, {F \ Adda) U DeQ}; 

• if a is executable in a and a is a sensing action then 

<I>(a, 0") = {cr'\a < a and Sensa \ a = a' \ a}. 

Here, _L denotes the "error state." $(a, a) = {_L} indicates that the action a cannot be 
executed in the a-state a. The next example illustrates the above definition. 

Example 2.5 (Getting to Evanston). Consider the a-state 

a = {{at-start}, {on-western, on-belmont, on-ashland, at-evanston}) . 
We have that check-traffic is executable in a and 

^{check-traffic, a) = {ai,a2} 

where: 

cji = {{at-start, traffic-bad} , {on-western, on-belmont, on-ashland, at-evanston}), 
CJ2 = {{at-start}, {traffic-bad, on-western, on-belmont, on-ashland, at-evanston}) . 
Similarly, 

^{goto-western-at-belmont, a) = {(T3} 
where: Us = ({on-western, on-belmont}, {at-start, on-ashland, at-evanston }). 

The function <I> can be extended to define the function <I>* that maps each pair of a 
conditional plan p and a-states a into a set of a-states, denoted by ^*{p,a). is defined 
similarly to the extended function $ in |2nj . 

Definition 2.6 (Extended Transition Function). For an a-state a, 
. ifc=[],then $*([], a) = {a}; 
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• if c = a and a is a non-sensing action, then <&*(c, a) = ^{a, a); 

• if c = a; case{ipi pi, . . . , ^ Pn) is a case plan, then 

$*(c, cj)= [J E{case{(pi ^ pi,. . . ,ipn ^ Pn),cr') 

where 

i5;fcasef(^i ^ ioi ^*(Pv^)^ if V'.' holds in 7 (1 < j < n); 

i^icase^v^i ^p„j,7j - I ^^^^ if none of 991, . . . , holds in 7. 

• if c is a conditional plan and a is a non-sensing action, then 

$*(a;c,cT)= U f*(c,cT'). 

(T'G$(a,a-) 

Furthermore, $*(c, _L) = {_L} for any conditional plan c. 

Intuitively, $*(c, cr) is the set of a-states resulting from the execution of the plan c in 

a. 

Given a planning problem P = {A,0,I,G), the a-state representing / is defined by 
(T/ = (I"*",/^). = {o" I (Jg ^ o"}, where ac = {G~^,G~), is the set of a-states satisfying 
the goal G. We define a progression solution as follows. 

Definition 2.7 (Progression Solution). A progression solution to the planning problem P 
is a conditional plan c such that <I>*(c, cr/) C Sc. 

Note that, since _L is not a member of Sc, we have that _L ^ '&*(c, cr/) if c is a progression 
solution to P. In other words, the execution of c will not fail if c is a progression solution 
of P. 

Example 2.8 (Getting to Evanston - cont'd). Let P = {A,0,I,G) where A and O are 
given in Figure and 

/ = {at-start, ^on-western, ^on-belmont, ^on-ashland, ^at-evanston}; 

G = {at-evanston}, 

respectively. We can easily check that the conditional plan in Example 12.31 is a progression 
solution of P. 



2.3. Some Properties of the Progression Function <I>. There have been several pro- 
posals on defining a progression function for domains with sensing actions and incomplete 
information |lUlll2l[T^ll8ll2Uj . We will show next that for domains considered in this paper, 
the function $ (Definition 12. 4|) is equivalent to the transition function defined in . By 
virtue of the equivalent results between various formalisms, in we can conclude that $ 
is equivalent to the progression functions defined in several other formalisms as well. First, 
let us review the definition of the function in [2111 , which will be denoted by We need 
the following notations. For an action theory given by a set of fluents A, a set of operators 
O, and an initial state /, a state s is a set of fluents. A combined state (or c-state) of an 
agent is a pair (s, S) where s is a state and S is a set of states. Intuitively, the state s in 
a c-state (s, S) represents the real state of the world whereas E is the set of possible states 
which an agent believes it might be in. A c-state a; = (s, S) is grounded if s G S. A fluent 
/ is true (resp. false) in s iff / G s (resp. f ^ s). / is known to be true (resp. false) in a 
c-state (s, S) iff / is true (resp. false) in every state s' G S; and / is known in (s, S), if / 
is known to be true or known to be false in (s, S). 
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For an action a and a state s, a is executable in s if Pre^ C s and Pre~ fl s = 0. 
The state resulting from executing a in s, denoted by Res{a,s), is defined by Res{a,s) = 
(s \ Dela) U Adda- The function $c is a mapping from pairs of actions and c-states into 
c-states and is defined as follows. For a c-state uj = {s, S) and action a, 

(1) if a is not executable in s then $c(a,w) is undefined, denoted by <I>c(a,cj) = -L; 

(2) if a is executable in s and a is a non-sensing action, then 

^dcLjUj) = {Res{a, s), {s' \ s' = Res{a,s"), 3s" € S s.t. a is executable in s"}); 
and 

(3) if a is executable in s and a is a sensing action then 

<I>c(ai'^) = (•5, {s' I s' E S s.t. Sensa \ s = Sensa \ s', and a is executable in s'}). 

The set of initial states of a planning problem P = {A, O, I, G) is Sq = {s | C s, and /^fi 
s = 0}; and the set of initial c-states of P, denoted by il/, is given by 0/ = {(so,So) | 
So € So}. The function <I>c can be extended to define an extended progression function 
$* over conditional plans and c-states, similar to the extended function in Definition 
12.61 The notion of a progression solution can then be defined accordingly. The following 
theorem states the equivalence between and <&c for domains representable by the action 
representation language given in the previous subsection. 

Proposition 2.9. For a planning problem {A, O, I,G), a conditional plan c is a progression 
solution with respect to $ iff it is a progression solution with respect to $c- 

Proof. For an a-state cr = (T, F), let = {s | T C s C yl and F n s = 0}, = {{T', F') \ 
T CT' Q A, F C F' C A, and T' n F' = 0}, and = {(s, S^)) | s G S^}. Furthermore, 
for an action a and a set of c-states il, let ^do-, ^2) = {^do-, uj) \ uj G il}. From the definition 
of ^ and <I>ci we can easily verify that the following properties hold: 

(1) An action a is executable in a iff a is executable in every c-state belonging to 

(2) If a non-sensing action a is executable in a and ^{a, a) = {{T' , F')} then 

T'= n » 

and 

F'= (^\^) 

uGS,(s,S)G'I>c{a,r2a) 

(3) If a sensing action a is executable in o" then 

cr'eA^, cr"G'I>(a,(7') 

The conclusion of the proposition can be verified using induction on the structure of a plan 
and the fact that for a planning problem P, 0/ = ^l^j . □ 
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Remark 2.10. For the discussion on the complexity of planning using the progression 
function it will be useful to note that $ is also equivalent to the 0-approximation $o 
defined in [50]. Indeed, this can be easily verified from the definitions of $o and In the 
notation of this paper, $o is also a mapping from pairs of actions and a-states into a-states 
and for an a-state a = {T,F) and an action a, ^Q(a,a) is defined as follows: 

• if a is not executable in a then ^o(a,a) = {-L}; 

• if a is executable in a and a is a non-sensing action then 

^>o(a, a) = {{{T \ Dela) U Adda, {F \ Adda) U Dela)}; 

• if a is executable in a and a is a sensing action then 

<I>o(a, c) = {c'Icr ■< a' and Sensa \cr = a' \ a}. 
This implies that <I> is identical to ^q. 

3. A State-Based Regression Formulation 

In this section, we present our formalization of a regression function, denoted by TZ, 
and prove that it is both sound and complete with respect to the progression function 
7^ is a state-based regression function that maps each pair of an action and a set of a-states 
into an a-state. 

Observe that our progression formulation states that a plan p achieves the goal G from 
an a-state a if G holds in all a-states belonging to ^*{p,a), i.e., G holds in r\a'G^*{p,a)'^' ■ 
In addition, similar to jlj, we will also define regression with respect to the goal. These 
suggest us to introduce the notion of a partial knowledge state (or p-state) as a pair [T, F] 
where T CI A and F C. A are two disjoint sets of fluents. Intuitively, a p-state 5 = [T, F] 
represents a collection of a-states which extend the a-state (T, F) . We denote this set by 
ext(S) and call it the extension set of 6. Formally, ext{5) = {{T',F') \ T Q T' C A, F Q 
F' A,T' D F' = 0}. Any a-state a' € ext{S) is called an extension of 6. Given a p-state 
6=[T,F], we say a partial state 6' = [T',F'] is a partial extension of (5 if T C T',F C F' . 
For a set of p-states A = {Si, . . . , 6n}, A' = {6[, . . . , S'^} is said to be an extension of A, 
written as A C A' if 5'^ is a partial extension of 5i for every i = 1, . . . ,n. For a fluent /, 
we say that / is true (resp. false, known, unknown) in 5 if / G T (/ G i^, / G T U -F, 
/ T U -F). A set of fluents S is said to be true (resp. false, known, unknown) in 5 if every 
fluent / in S" is true (resp. false, known, unknown) in 6. 

The regression function TZ will be defined separately for non-sensing actions and sensing 
actions to take into consideration the fact that the execution of a non-sensing action (resp. 
sensing action) in an a-state results in a single a-state (resp. set of a-states). Thereafter, 
TZ is extended to define regression over conditional plans. The key requirement on TZ is 
that it should be sound (i.e., plans obtained through regression must be plans based on 
the progression function) and complete (i.e., for each plan based on progression, using 
regression one should obtain that plan or a simpler plan with the same effects) with respect 
to progression. We will also need to characterize the conditions under which an action should 
not be used for regression. Following we refer to this condition as "the applicability 
condition." We begin with non-sensing actions. 
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3.1. Regression Over Non-Sensing Actions. We begin with the apphcabihty condition 
of non-sensing actions and then give the definition of the function TZ for non-sensing actions. 

Definition 3.1 (Regression Applicabihty Condition - Non-Sensing Action). Given a non- 
sensing action a and a p-state S = [T, F] . We say that a is applicable in S if 

(i) Adda n r 7^ or Dela n F 7^ 0, and 

(ii) Adda n F = 0, Dela n T = 0, Pre+ RFC Dela, and Pre' DT Q Adda- 

Intuitively, the aforementioned apphcability condition requires that a is relevant (item 
(i)) and consistent (item (ii)) in S. Item (i) is considered "relevant" as it makes sure that 
the effects of a will contribute to 5 after its execution. Item (ii) is considered "consistent" 
as it makes sure that the situation obtained by progressing a, from a situation yielded by 
regressing from S through a, will be consistent with 6. Observe also that this definition 
will exclude the conventional operator no-op from consideration for regression as it is never 
applicable. 

Since the application of a non-sensing action in an a-state results in a single a-state, the 
regression of a p-state over a non-sensing action should result in a p-state. This is defined 
next. 

Definition 3.2 (Regression - Non-Sensing Action). Given a non-sensing action a and a 

p-statc 6 = [T, F], 

• if a is not applicable in 6 then TZ{a, 5) = ±; 

• if a is applicable in S then 7^(a, 5) = [(T \ Adda) U Pre+, {F \ Dela) U Pre']. 

Like in the progression function, the symbol _L indicates a "failure." In other words, 
'lZ{a, 5) = J- means that S cannot be regressed on a (or the regression from 5 over a fails). 
For later use, we extend the regression function TZ for non-sensing actions over a set of 
p-states and define 

7^(a, {(5i, . . . ,(5n}) = {R{a,6i), . . . ,Tl{a,dn)} 
where (5i, . . . , 5„ are p-states and a is a non-sensing action. 

Example 3.3 (Getting to Evanston - con't). The actions take-western and take-ashland 
are applicable m. 5 = [{at-evanston}, {}]. 

TZ{take-western, 5) = [{on-western}, {traffic- bad}], and 

TZ{take-ashland, 6) = [{on-ashland}, {}]. 

3.2. Regression Over Sensing Actions. Let a be a sensing action and a be an a-state. 
The definition of the progression function $ states that the execution of a in cr results in a 

set of a-states $(a, cj). Furthermore, if a is executable in a then every member of $(a, cr) 
extends a by a set of fluents Sa Q SenSa and every / G SenSa \ Sa is known in a. As such, 
the regression over a sensing action should be with respect to a set of p-states and result in 
a p-statc. Moreover, our definition for the applicability condition of a sensing action must 
account for the fact that the set of p-states, from which the regression is done, satisfies the 
two properties: (i) SenSa is known in each of its members; and (ii) the difference between 
two of its members is exactly SenSa- This leads to the following definition. 

Definition 3.4 (Sensed Set of Fluents). Let A = {Si, ... , 5n} be a set of p-states and a be 
a sensing action. A sensed set of fluents of A with respect to a, denoted by p(a. A), is a 
non-empty subset of SenSa satisfying the following properties: 
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• Sens a is known in A; 

• n = 2lP('^'^)l; 

• for every partition^ {P-,Q) of p{a, A), there exists only one Si G A {1 < i < n) such that 
5i.T n p{a, A) = P, di.F np{a,A) = Q; and 

• Si.T \p{a, A) = 6j.T \p{a, A) and 6i.F \p{a, A) = 6j.F \p{a, A) for every pair of i and 
j , ^ ^ i ^ n and 1 < j < n. 

It can be seen from Definition l2.4l (Case 2) that when a sensing action a is executed in an 
a-state a, the result is a set of a-states $(a, a) where for each a' G <l>(a, cr), (t'\(T = Sensa\cr. 
The above definition captures the inverse of the progression process. Intuitively, p{a, A) 
is the set of fluents which are unknown before the execution of a and are known after its 
execution; for example, if A = ^{a,a), then p{a,A) should encode the set Sensa \ o. It 
is easy to see that the second condition on p(a. A) warrants that it is a maximal subset of 
SenSa satisfying the four stated conditions. Observe also that due to the second condition, 
A must be a non-empty set. The next lemma proves that the sensed set of a set of p-states 
with respect to an action is unique. 

Lemma 3.5. For every sensing action a and set of p-states A, p{a, A) is unique if it exists. 

Proof. Abusing the notation, we write p{a, A) = 1. whenever p{a, A) does not exist. Clearly, 
the lemma holds if A = as p{a, A) = _L for every a. So, we need to prove it for the case 
A 7^0. 

Assume that p{a, A) exists but it is not unique, i.e, we can find different sensed sets of 
A with respect to a, say X and X' . By Definition 13.41 we have that X 7^ and X' ^ 0. 

Since X 7^ 0, let us consider a fluent / G X. By Deflnition 13.41 for two partitions 
({/}, X\{f}) and {X\{f}, {/}) of X, there exist 5 G A and 5' e A such that {/} = 5.TnX 
and {/} = S'.F n X, i.e. / is true in 6 and false in 6'. [*]. 

Suppose that / X' . By Item 4, Deflnition El either f G 6.T\X' ov f e 5.F \ X' for 
(5 € A, i.e / is either true or false in every 5 G A. In either case, this contradicts with [*]. 
Therefore, / G X'. 

Symmetrically, we can argue that, if / G X' then / G X. Thus, / G X iff / G X', i.e. 
X = X'. □ 

Definition 3.6 (Properness). A set of p-states A is proper with respect to a sensing action 
a ff p(a, A) / _L. 

For convenience, we sometime write p{a, A) = _L to indicate that A is not proper with 
respect to a. 

Example 3.7 (Getting to Evanston - Cond't). Consider a set Ai = {(5i,(^2} where 5i = 
[{at- start, traffic- bad}, {on-western, on-belmont, on-ashland, at-evanston}] and 

62 = [{at-start}, {traffic-bad, on-western, on-belmont, on-ashland, at-evanston}]. 

We can easily check that 

p{check- tra ffic, Ai) = {traffic-bad}. 

So, Ai is proper with respect to check- traffic. 
On the other hand 

p{check-tra ffic, A2) = ^. 



'For a set of fluents X, a partition of X is a pair of sets of fluents {P, Q) where PnQ — and PuQ — X. 
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where A2 = {61,63} and 63 = [{at-start}, {traffic-bad, at-evanston}]. This is because the 
fourth condition fDefinition l3.4|) cannot be satisfied for any non-empty subset of traffic-bad. 
So, A2 is not proper with respect to check-traffic. 

We are now ready to define the apphcabihty condition for sensing actions. The definition 
is given in two steps. First, we define the strong apphcabihty condition as fohows. 

Definition 3.8 (Strong Regression Applicabihty Condition - Sensing Action). Let a be a 
sensing action and A be a set of p-states. We say that a is strongly applicable in A if 
(i) p{a, A) 7^ _L; and 

(h) Pre+ n (5.F = and Pre~ n 5.r = for every 6 e A. 

In the above definition, (i) and (ii) correspond to the "relevancy" and "consistency" 
requirement for non-sensing actions (Definition l3.1|) respectively, (i) corresponds to the fact 
that executing a sensing action a in an a-state a results in a set of 2^^^°"'^^^ a-states, each 
of which extends a by p{a. A) and (ii) guarantees that a must be executable prior to its 
execution. 

It is easy to see that if a sensing action a is strongly applicable in A, then for every 
a-state a' extending the p-state 

6' = [{{[j6.T)\pia,A))UPre+,{{\J <5.F) \ p(a, A)) U Pre"] 
<5gA 6eA 

it holds that every member of ^{a,a') belongs to the extension of some 6i € A. As such, 
6' could be viewed as the result of the regression from A through a. Unfortunately, the 
conditions in Definition 13.81 are sometime unnecessarily strong as the following example 
demonstrates. 

Example 3.9 (Strong Regression Applicability Condition). Let 

P = {{f,9,h},{sensef,ai,a2},{h},{g}) 
be a planning problem, where sense f is a sensing action with 

Pf^sensej — {^}) SenSgensej — {/}> 

oi and 02 are two non-sensing actions with 

Preai = {hj}, Adda, = {g},Dela, = 0, 
Prca^ = {^/}, Adda2 = {9}, and Dela2 = ^■ 

Clearly, 

c = sense f, case{f — > ai, 02) 
is a progression solution to P. Thus, it is reasonable to expect that if we regress from the 
goal 6 = [{g},^\ on c — step-by-step — we will receive a p-state 6' such that ({/i},0) G 
ext{6'). This process begins with the regression on ai and 02 from 6. Thereafter, we 
receive a set of p-states from which the regression on sense f can be done. It is easy to see 
that TZ{ai,6) = [{h,f},$] = 61 and 7l{a2,6) = [0, {/}] = 62. It is also easy to see that 
the strong applicability condition implies that sense f is not applicable in {61,62} because 
p{sensef, {61,62}) = -L. This means that, we cannot regress on c from the goal state. 

Notice that the problem in the above example lies in the fact that {61, 62} violates the 
properness definition in that 61 and 62 do not have the same values on the set of fiuents that 
do not belong to Sens sense j- To overcome the problem posed by the strong applicability 
condition, we relax this condition. 
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Definition 3.10 (Regression Applicability Condition - Sensing Action). Let a be a sensing 
action and A be a set of p-states. a is applicable in A if 

(i) there exists a set of p-states A' such that A C A' and a is strongly applicable in A'; 
and 

(ii) Sens a is known in A. 

Example 3.11 (Continuation of Example 13. 9|) . It is easy to see that sense j is applicable 
in {81,62} since it is strongly applicable in {61,62} where 62 = [{h},{f}] and {61,62} Q 
{Si,6'2}. 

Definition 3.12 (Sensed Set). Let A be a set of p-states and a be a sensing action such 
that a is applicable in A. We say that X is a sensed set of fluents of A with respect to 
a, denoted by Sa^A, if there exists a set of p-states A' such that A C A', o is strongly 
applicable in A', and X = p{a, A'). 

Again, we write Sa^A = -L to say that the sensed set of fluents of A with respect to a 
does not exist. The next lemma states that Sa^A is unique. 

Lemma 3.13. For every sensing action a and set of p-states A, Sa^A is unique if it exists. 

Proof. Obviously, the lemma holds for A = 0. So, we need to prove it for the case A 7^ 0. 

Assume the contrary, Sa,A is not unique. This implies that there exists A' and A" such 
that A E A' and A C A", p{a,A') / _L, p(a. A") 7^ _L, and p{a,A') ^ p{a,A"). Again, 
by Definition 13.41 we can conclude that p{a. A') ^ and p{a. A") ^ 0. Without loss of 
generality, we conclude that there exists some / € p{a, A') \ p{a, A"). 

Since p{a, A") 7^ _L, / € Sensa, and / is known in A", by Definition 13.41 we must have 
two cases. 

(1) / e 6".T\p{a,A") for every 6" G A". Since / G p{a,A'), by Definition lOl for the 
partition (p(a. A') \ {/}, {/}) oip{a,A'), there exists 6' G A' such that 6'.Fnp{a,A') = 
{/}, i.e. / is false in 6' . 

Because A C A', there exists some (5 G A such that 6' is a partial extension of 6. So, 
we have that 6.F C 6' .F. Also, as SenSa is known in 6, we must have that / G 6.F. 

Since A C A", we know that there exists some 6" G A" which is a partial extension 
of 6. This implies that 6.F C 6" .F, i.e., / G 6" .F. This contradicts with the fact that 
/ G 6".T. 

(2) / G 6" .F \p(a,A") for every 6" G A". Similarly to the first case, we can derive a 
contradiction. 

The above two cases show that if / G p{a. A') then / G p{a, A"). 

This shows that p{a, A') = p{a. A"). □ 

We illustrate the above definition in the next example. 

Example 3.14 (Getting to Evanston - con't). Consider the set A2 and the sensing action 
check- traffic in Example 13.71 We have that 

(i) check-traffic is not strongly applicable in A2 (because p{check-tra ffic, A2) = -L, Ex- 
ample EIZl); however, 

(ii) check-traffic is applicable in A2. This is because Ai (Example 13.7)1 consists of partial 
extensions of p-states in A2, and check-traffic is strongly applicable in Ai. 

We are now ready to define the regression function for sensing actions. 
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Definition 3.15 (Regression - Sensing Action). Let a be a sensing action and A be a set 
of p-states. 

• if a is not applicable in A then TZ{a,A) = _L; and 

• if a is applicable in A 

7^(a, A) = [(( U 6.T) \ Sa,A) U Pre+, (( [J 6.F) \ 5„,a) U Pre"]. 
<5eA <5gA 

Example 3.16 (Getting to Evanston - Cond't). The action check-traffic is applicable in 
A2 with respect to {traffic-bad} (see Example K-i.l4|) and we have 
TZ{check- traffic, A2) = 

[{at-start}, {on-western, on-belmont, on-ashland, at-evanston}]. 

3.3. Regression Over Conditional Plans. We now extend TZ to define IZ* that allows 
us to perform regression over conditional plans. For a conjunction of fluent literals, by 
and y?" we denote the sets of fluents occurring positively and negatively in (p, respectively. 

Definition 3.17 (Extended Regression Function). Let (5 be a p-state. The extended tran- 
sition function TZ* is defined as follows: 

• n\[],5) = 6. 

• For a non-sensing action a, TZ*{a,5) = TZ{a,5). 

• For a conditional plan p = a; case((/?i— >ci, . . . , (fn^Cn) where a is a sensing action and 
Cj's are conditional plans, 

- if TZ* {ci,6)=l- for some i, lZ*{jp,5) = _L; 

- if n*lci,5)=[Ti, Fi] for i = 1, . . . , n, then 

TZ*{p, 5) = TZ{a, {R{ipi ^ ci,5),..., R{ifn c„, 5)}) 

where R{^pi Ci,5) = [Ti U ipt,Fi U ip^] if ipf n Fi = 9 and (pr n Tj = 0; otherwise, 
R{ipi Ci,6) = _L. 

• For p = a;c, where a is a non-sensing action and c is a conditional plan, 

TZ*{p,6) = TZ{a,TZ*{c,5)); 

• TZ*{p, _L) =_L for every plan p. 

The notion of a regression solution is defined as follows. 

Definition 3.18 (Regression Solution). A conditional plan c is a regression solution to 
the planning problem P = {A,0,I,G) if 7Z*{c,5g) 7^ -L and ai G ext{TZ* {c, 6g)) where 
6g = [G+,G-] and aj = (/+,/"). 

The above definition is a generalization of the notion of a plan obtained by regression 
in domains without sensing actions and with complete information about the initial state 
to domains with sensing actions and incomplete information. An important property that 
any regression function needs to satisfy is its soundness with respect to the corresponding 
progression function. Here, we would like to guarantee that TZ and TZ* are sound with 
respect to the progression function <I> and respectively. As such, we require that a 
regression solution c to a planning problem P = {A, O, I, G) be a plan achieving the goal 
G from /. This property is proved in Theorem 14.81 

As the soundness of the regression function with respect to the progression function is 
guaranteed, it will be interesting to investigate its completeness. In this paper, we opt for a 
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definition that — when used in planning — wiU give us optimal solutions in the sense that 
regression solutions do not contain redundant actions. This is evident from Definitions 13.11 
and 13.101 in which we require that the action, over which the regression is done, must add 
new information to the regressed state. We will elaborate in more detail on this point in 
the next section. 



4. Soundness and Completeness Results 

In this section, we show that our regression function TZ* is sound and complete with 
respect to the progression function <I>. 



4.1. Soundness Result. As with its definition, the soundness of TZ* is proved in two steps. 
First, we prove the soundness of TZ, separately for non-sensing and sensing actions. Second, 
we extend this result to regression solutions. To establish the soundness of TZ on non-sensing 
actions, we need the following lemma. 

Lemma 4.1. Let 5 be a p-state. An a-state a is an extension of 5 (i.e. a E ext{6)) iff a 
is an a-state of the form {6.T U X, 5.F U Y) where X, Y are two disjoint sets of fluents and 

xn5.F = %, y n 5.T = 0. 

Proof. 

• Case 

Let a G ext{5) be an extension of 6. By the definition of an extension, a is an a-state 
where 5.T C a.T and 5.F C a.F. Denote X = a.T\ 6.T and Y = a.F\ 6.F. Clearly, X 
and Y are two set of fluents where X n F = and X n 5.F = 0, 1" n 6.T = 0. 

• Case 

Let a be an a-state of the form {6.T U X, 6.F U Y) where X, Y are two disjoint sets of 
fluents and Xn6.F = 9, Yn 6.T = 0. 

It's easy to see that a.T f] a.F = 0, i.e. a is consistent. Furthermore, 5.T C a.T and 
5.F C a.F, i.e. by definition of an extension, a is an extension of 5. □ 

Intuitively, the soundness of TZ for a non-sensing action states that the regression over 
a non-sensing action from a p-state yields another p-state such that the execution of the 
action in any extension of the latter results in a subset of a-states belonging to the extension 
set of the former. This is illustrated in Figure [21 
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Figure 2: Illustration of Theorem 14.21 



16 



L.-C. TUAN, C. BARAL, AND T. C. SON 



Theorem 4.2 (Non-sensing Action). Let 6 he a p-state and a be a non-sensing action. If 
Tl{a, 6) = 6' and 6' ^ _L, then for every a" € ext{6') we have that $(o, a") C ext(6). 

Proof. Let 6 = [T,F]. From the fact that TZ{a,6) = 5' 7^ _L, we have that a is appUcable in 
S. 

By Definition EH 

6' = n{6, a) = [{T \ Adda) U Pre+, {F \ DeL) U Pre-]. 

Let a" £ ext{6'). It follows from Lemma l4. II that 

a" = {{T \ Adda) U Pret UX,{F\ Dela) U Pre' U Y), 

where X and Y are two sets of fluents such that a" .T n a" .F = 0. We now prove that (i) a 
is executable in a" and (ii) ^{a,a") C ext{6). 

• Proof of (i): 

Since Pre^ C a".T and Pre~ C a" .F, we conclude that /eml — maintexta is exe- 
cutable in cj". 

• Proof of (ii): 

By definition of the transition function $, we have that 

<^{a,a") = {mT\Adda)(JPretuX)\Dela)UAdda,{{iF\Dela)UPre-UY)\Adda)(JDela)} 

Since a is applicable in 6, we have that T n Dela = ^, F n Adda = 0- Furthermore, 
I^eZa n ^dda = 0- Therefore, we have that (((r \ Adda) U Pre+ UX)\ Dela) U Adda = 
((T \ Adda) U ((Pre+ U X) \ L>e/a)) U Adda 2 T U ((Pre+ U X) \ L»e/a) 2 T. This 
concludes that T C <I>(a, a").T. Similarly, we have that F C $(0, a").F. This shows that 
^(a,cT") C ext((^). □ 

Observe that the conclusion of the theorem indicates that _L <I>(a,cj"), i.e., a is 
executable in a" . This shows that IZ can be "reversed" for non-sensing actions. 

We will next establish a result similar to Theorem 14.21 for sensing actions. Intuitively, 
the result should state that the regression over a sensing action from a set of p-states yields 
a p-state such that the execution of the action in any extension of the latter results in a set 
of a-states belonging to the union of the extension sets of the former, i.e., it should allow 
us to conclude that TZ can be "reversed" for sensing actions. Figure |31 illustrates this idea. 
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Figure 3: Illustration of Theorem 14.41 



We need the following lemma. 
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Lemma 4.3. Let a' be an a-state and a be a sensing action executable in a' . For any 
Sa ^ Sensa and a € <I>(a, a'), let a.T r\ Sa = and cr.F H Sa = , we have that 
S+US- = Sa and S+ n 5- = 0. 

Proof. It is easy to see that the lemma is correct for the case Sa = 0. Let us consider the 
case Sa / 0. Since S^ C a.T and S~ C a.F, we have that 5+ n 5~ = 0. . This also shows 
Consider / € S^ U 5"", we have that / e 5+ or / G 5". In both cases, we have f € Sa- 

Consider f G Sa- Since Sa ^ Sens a, we have that / G Sens a- By the definition of $, 
we have that / € a.T or / € cr.F. From this fact, it's easy to see that / £ S'^ or / G S"". □ 

With the help of the above lemma, we can prove the following theorem. 

Theorem 4.4 (Sensing action). Let A be a set of p-states and a be a sensing action. If 
7^(a, A) = 5' and 5' 7^ _L, then for every a" G ext{6'), we have that <I>(a, a") C IJ^gA &xt{6). 

Proof. From the fact that TZ{a, A) = 5' 7^ _L, we have that o is applicable in A with respect 
to some set Sa,A ^ Sens a (5'a,A 7^ 0)- By Definition 13. 151 we have: 

5' = 7^(a, A) = [( U 6.T \ Sa,A) U Pre+, {[j6.F\ Sa,A) U Pre-]. 
<5eA <5eA 
Let a" € ext{5') be an arbitrary extension of 6' . We will now prove (i) a is executable in 
a" and (ii) <^{a,a") C U^gA^^^W- 

• Proof of (i) : It follows from Lemma 14.11 that 

a" = (( U S.T \ Sa,A) U Pret UX,{\J 6.F\ 5,,a) U Pre" U Y) 
5eA SeA 

where X and y are two sets of fluents such that a" .T n a" .F = 0. 

Prom the fact that Pre^ C cj".T and Pre~ C c7".F, we conclude that a is executable in 

[*] 

• Proof of (ii): Consider an arbitrary a € ^{a,a"). We need to prove that there exists 
some 5 G A such that a £ ext{6). 

Since a is applicable in A, by Definition 13.101 there exists A' such that A C A' and a 
is strongly applicable in A' and 5a, a = pi^i A'). 

Let 5^ = (J.TriSa^A and S^ = a.FnSa^A- By LemmaEHl we have that S^US^ = Sa,A 
and S+ n 5- = 0. ' 

By Definitional there exists 6' G A' such that 6'.TnSa,A = 5*+ and 6'.FnSa,A = S~ . 
Because A C A', there exists some 6 € A such that S' is a partial extension of S. 
We will show that a G ext{5), i.e., 6.T C a.T and 6.F C a.F. 
Since d.T C 5' .T, we have that 6.T n 5a, a ^ (^'.T fl 5a, a = S^. Therefore: 

d.T = {6.T\{6.TnSa,A))^{S-TnSa,A) 

= (S.T \ Sa,A) U {S.T n 5a,A) 
C (5.r\5a,A)U5+. 

Similarly, we can show that 6.F C ((5.F \ 5a,A) U S~ . 

Since a G $(a, a"), by the definition of we have that a" .T C cr.T. Let a.T\a" .T = lv, 
we have that 

a.T = a".T u w = (( U S.T) \ 5a,A) U Pre+ U X U w. 
<5eA 
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Since (T.Tn5a,A = and {{{{Jg^/^5.T)\Sa,A)^Pre'^)riSa,A = (because ^enSaflPre^ = 
0), we must have that (X U lo) n Sa^A = S^, i.e. 5^ C X U w. From the fact that 
6.T C [5.T \ Sa,A) U 5j" and C X U tj, it is easy to see that S.T C a.T. Similarly, we 
can show that 6.F C a.F. From this fact, we conclude that a G ext{6). [**] 
From [*] and [**] the theorem is proved. □ 

To prove the final result about the correctness of TZ (and Theorem 14.271 in the next 
section) we need a number of additional notations and definitions. 

Definition 4.5 (Branching Count). Let c be a conditional plan, we define the number of 
case plans of c, denoted by count{c), inductively as follows: 

(1) if c = [ ] then count{c) = 0; 

(2) if c = a, a is a non-sensing action, then count{c) = 0; 

(3) if a is a non-sensing action and c is a conditional plan then count{a; c) = count{c); 

(4) if c is a case plan of the form a; case{<pi — > ci, . . . , — > Cn) where a is a sensing action, 
then count{c) = 1 + X^ILi count{ci). 

Lemma 4.6 (Sequence of Non-sensing Action). For p-states 6 and 5', and a sequence of non- 
sensing actions c = oi; . . . ;a„ (n > 0), 7^*(c, 5) = 5' / _L implies that <I>*(c, a") C ext{6) 
for every a" E ext{6'). 

Proof. By induction on n. 

• Base Case: n = 1. This means that c has only one action a. Using Theorem 14.21 and 
Definition 13.171 - item 2 - the base case is proved. Notice that for the case n = 0, i.e. 
c = [ ] , the lemma follows directly from Definitions 13.171 and 12.61 

• Inductive Step: 

Assume that the lemma is shown for 1 < n < k. We now prove the lemma for n = k-\-l. 
Let c' = 02; . . . ; afc+i and 7^*(c^ 6) =5*. By Definition ITTTI 

n*{c,6) =n{ai,n*{c',6)) = 6'. 
Since TZ{ai, 6*) = 5' ^ we have that 5* / _L. 

Let a" e ext{5'). By Theorem lO we have that ^{ai,a") = {a} C ext{5*), i.e., a G 
ext{5*). 

By the definition of we also have that $*(c, a") = $*(c', $*(ai, a")). Using the 
induction hypothesis for c', where TZ*{c',5) = 5* and a G ext{5*), we have: 

$*(c',«>*(ai,cj")) = $*(c',(j) <^ext{5). 

Therefore, ^*{c,a") C ext{5). □ 

Lemma 4.7. Let 5 be a p-state and c be a conditional plan. If lZ*{c,6) = 6' and 6' ^ X, 
then for every a G ext{5'), ^*{c,a) C ext{5). 

Proof. By induction on count{c), the number of case plans in c. 

• Base Case: count{c) = 0. Then c is a sequence of non-sensing actions. The base case 
follows from Lemma 14.61 

• Inductive Step: Assume that we have proved the lemma for count{c) < k {k > 0). We 
need to prove the lemma for count{c) = A; -|- 1. By the definition of a conditional plan, 
we have two cases: 
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(1) c = a;p is a case plan where a is a sensing action and p = case {(pi — > pi, . . . , ipm — > 
Pm)- Since count{c) = 1 + YlT=i count{pj) < k + 1, we have that count(pi) < k for 
i = 1, ... ,171. By Definition 13.171 

±^5' = 7^*(c, 6) = 7^(a, {R{ipi ^pi,6),..., R{ipm ^ Pm, S)}). 

Let us denote R{(pi — > pi, S) by (5j (1 < i < ni) and A = {6i, . . . , 6m}- We have that 
(5i \= ifi for 1 < i < m, and a is apphcable in A. 
Prom Theorem 14 .41 we have that 

^{a,(T) C IJ ext{5") 

for every a G ext{5'). 

Consider an arbitrary a' € $(a,a"). Because of the above relation, we can con- 
clude that there exists some i, 1 < i < m, such that a' G ext{6i). Because 
n*ipi,6).T C R{ipi ^ pi,6).T and 7^*(p^,(^).F C R{ipi ^ ct' G ext{6i) 

implies a' G ext{Tl*{pi,6)). Using inductive hypothesis for count{pi) < k, we have 
that ^*{pi,a') C ext{6). Since this holds for every a' G $(o, cr), from Definition 12.61 
we conclude that $*(c, cr) C ext(5). 

(2) c = a;p where o is a non-sensing action and p is a conditional plan. Because 
count {c) > 0, from Definition 12.21 we conclude that there exists a sequence of non- 
sensing actions bi,...,bt and a case plan q such that c = bi; . . . -jbt; q. Let c' = 
bi;...;bt and TZ*{q,5) = 6*. Using the first case, we can show that for every 
a' G ext{6*), <!>*((?, fj') C ext{6). Furthermore, because 

6' = TZ*{c,6) = TZ*{c',n*{q,6)) 

and Lemma 14.61 we can show that for every a G ext{6), <&*(c, a) C ext{5). 

From cases 1 and 2, the lemma is proved. □ 

We are now ready to prove the soundness of the extended regression function TZ* with 
respect to the extended progression transition function which is illustrated in the next 
figure. 
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Figure 4: Soundness of TZ* 



Theorem 4.8 (Soundness of Regression). Let P = {A,0,I,G) be a planning problem 
and c be a regression solution of P. Then, c is also a progression solution of P, i.e., 
^*(c, o-/) C ext{SG). 

Proof. Let 6' = TI*{c,5g)- Since 5' 7^ _L and cj/ G ext{6') (Definition 13.18j) . the conclusion 
of the theorem follows immediately from Lemma 14.71 □ 
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4.2. Completeness Result. We now proceed towards a completeness result. Ideally, one 
would like to have a completeness result that expresses that for a given planning problem, 
any progression solution can also be found by regression. In our formulation, however, the 
definition of the progression function allows an action a to execute in any a-state a if a is 
executable in a, regardless whether or not a would add "new" information to a. In contrast, 
our definition of the regression function requires that an action a can only be applied in a 
p-state (or a set of p-states) if a contributes something to the applied p-state(s) ^. Thus, 
given a planning problem P = {A,0,I,G), a progression solution c of P may contain 
redundant actions or extra branches. As a result, we may not obtain c via our regression, 
i.e. TZ* {c,5g) = -L- To illustrate this point, let us consider the following two examples. 

Example 4.9 (Redundancy). Let P = ({/, g}, {b, c}, {/}, {g}) be a planning problem where 
c is a non-sensing action with Prcc = {/}, Addc = {g}, and Dele = 0; 5 is also a non-sensing 
action with Pre^ = {g}, Add;, = {/}, and Delf, = 0. Clearly 

Pi = c P2 = c;b = c;c 

are three progression solutions of P. Plan pi indicates that b (in P2) and a copy (a.k.a. an 
instance) of c (in ^3) are redundant. 
It is easy to check that 

7^*(p2,[M,0])=7^*(P3,[M,0]) = ^ 

whereas 

[M, 0]) = [{/}, 0]. 

Example 4.10 (Redundancy). Let P = {{f,g},{b,c},{f},{g}) be a planning problem. 
Let c be a sensing action where Prcc = 0, Sensc = {/, 9}; 6 is a non-sensing action where 
Preh = {/, -ifif}, Addh = {g}, and Delb = 0. A plan achieving g is: 

p = c; caseif A ^ b, f A g ^ [],^f A ^g ^ [],^f A g ^ []). 

Notice that, the conditions A ^g and A g are always evaluated to false after the 
execution of c because / is true before the execution of c. Thus, the two last branches of p 
are never used to achieve g. 
We have that 

^*([]JM,0]) = [W,0] 

7^*(5, [{5},0])=7^(6, [M, 0]) = [{/}, W] 

We can also verify that 

R{f A -5 - 6, [{g}, 0]) = [{/}, {g}] R{fAg^[], [{g}, 0]) = [{/, g}, 0] 
Rhf A -5 - 0, [{9}, 0]) = ^ Rhf A 5 - 0, [{9}, 0]) = [{9}, {/}] 

This implies that 

n*{p, [{g}, 0]) = TZic {[{/}, {g}], [{/, g}, 0], ±}) = ±. 
Let p' be the conditional plan obtained from p by removing the last two branches of p, i.e., 

p' = c; case{f A ^g ^ b, f A g ^ []). 
We can easily check that n*{p\ [{g}, 0]) = [{/}, 0] / ±. 

''Note that this condition is also applied for regression planning systems such as |3] and |14|. 



STATE-BASED REGRESSION IN INCOMPLETE DOMAINS 



21 



The above discussion suggests us the following completeness result: if a conditional plan 
can be found through progression we can find an equivalent conditional plan through re- 
gression. The plan found through regression does not have redundancies, both in terms of 
extra actions and extra branches. We refer to these notions as "redundancy" and "plan 
equivalence". We now formalize these notions. 

Definition 4.11 (Subplan). Let c be a conditional plan. A conditional plan d is a subplan 
of c if 

• c' can be obtained from c by 

(i) removing an instance of a non-sensing action from c; or 

(ii) removing a case plan or a branch ipi — s- q from a case plan in c; or 

(iii) replacing a case plan a; case{ipi ^ pi; c„ . . . , Pm) in c with one of its branches 
Pi for some i, 1 < i < m; or 

• c' is a subplan of c" where c" is a subplan of c. 

The above definition allows us to define redundant plans as follows. 

Definition 4.12 (Redundancy). Let c be a conditional plan, a be an a-state, and 5 be a 
p-state. We say that c contains redundancy (or is redundant) with respect to (ex, 5) if 

(i) $*(c, cj) C ext{6); and 

(ii) there exists a subplan c' of c with respect to a such that ^*{c',a) C ext{6). 

Note that, if c' is a subplan of a conditional plan c then c' ^ c. The equivalence of two 
conditional plans is defined formally as follows. 

Definition 4.13 (Equivalent Plan). Let a be an a-state, 5 be a p-state, and c be a condi- 
tional plan such that and $*(c, cr) C ext{6). A conditional plan c' is equivalent to c with 
respect to (a, 5) if <I>*(c',cr) C ext{6). 

Example 4.14 (Equivalence). Consider the plans in Example 14.91 we have that pi is a 
subplan of which is equivalent to ps with respect to (({/}, 0), [{5},0])- 
Similarly, for planning problem in Example 14.101 p' is a subplan of p and is equivalent to p 
with respect to (({/}, 0), [{5}, 0])- 

It is easy to see that if c' and c" are equivalent to c with respect to {a, 6) then c' and 
c" are equivalent with respect to (cr, 5) . To prove the completeness result of our regression 
formulation, we will need to introduce a few more definitions and notations. Recall that our 
purpose is to use regression to find an equivalent conditional plan for a given progression 
solution. To do that, we will provide conditions characterizing when a conditional plan 
is regressable, i.e. when the TZ* function can be applied on it to produce a p-state. We 
refer to conditional plans satisfying such conditions as regressable conditional plans. We 
will later show that, for a given progression solution of a planning problem P there exists 
an equivalent, regressable conditional plan that is also a regression solution of P. 

To define a regressable conditional plan, we begin with some additional notations. For 
a non-empty set of fluents S = {/i, fk}, a binary representation of 5 is a formula of the 
form li A ... A Ik where k G {/j, -■/i} for z = 1, . . . , fc. 

For a non-empty set of fluents S, let BIN(S) denote the set of all different binary 
representations of S. We say a conjunction cp of literals is consistent if there exists no 
fluent / such that both / and ->/ appear in cp. A set of consistent conjunctions of literals 
X = {(fi , . . . , (pn} is said to span over some set of fluents S if there exists a consistent 
conjunction of literals (/? x? such that: 
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(1) S n {ip^ U if ) = where and tp denote the sets of fluents occurrmg positive and 
negative in ip, respectively; 

(2) = 99 A where BIN{S) = {V'l, • • -^tpn}- 

Notice that for a non-empty set S, we can easily check whether the set x = {vi) • • • i V'n} 
spans over S. We say that a set x = Wi, ■ ■ ■ , V'n} is factorable if it spans over some non- 
empty set of fluents S. 

Example 4.15 (Getting to Evanston - Cond't). Consider a set S = {traffic-bad}, a con- 
junction if = on-ashland and a set of conjunctions x = {on-ashland A traffic-bad, on- 
ashland A ^traffic-bad}. 

We have that BIN{S) = {traffic-bad, ^traffic-bad} and x spans over S. 

We can show that for a non-empty set of consistent conjunctions of literals x = 
{ifi, . . . , ifn} be a non-empty set if x is factorable, then there exists a unique non-empty 
set of fluents S such that x spans over S. This allows us to define the notion of regressable 
plans as follows. 

Definition 4.16 (Potentially Regressable Case Plan). A case plan 

p = a; case{(pi ^ ci, . . . ,ipn ^ Cn) 

is potentially regressable if 

(i) there exists a non-empty set 7^ S'a C Sensa such that {tpi, . . . , spans over Sa, 
and 

(ii) for 1 < i < n, SenSa ^ [tpf U ip^). 

Definition 4.17 (Regressable Conditional Plan). Let c be a conditional plan, a be an 
a-state, and 5 be a p-state. We say c is regressable with respect to {a, 6) if 

(i) every case plan occurring in c is potentially regressable, 

(h) ^*{c,a) C ext{5), and 

(iii) c is not redundant with respect to {a, 5) . 

We will now prove a series of lemmae that will be used in the proof of the completeness 
of TZ* . Lemma 14.181 is about the uniqueness of a set of literals over which a factorable set of 
conjunctions spans. Lemmae 14. 1914. 2()1 state that the regressable property of a sequence of 
non-sensing actions is maintained by the function TZ* . Lemma l4. 21114.281 extend this result 
to regressable conditional plans. Lemmae 14 . 2414 . 26l show that for each progression solution 
there exists an equivalent regressable plan which can be found through regression. 

Lemma 4.18. Let x = {'■PIt ■ ■ iH^n} be a non-empty set of consistent conjunctions of 
literals. If x is factorable, then there exists a unique non-empty set of fiuents S such that 
X spans over S. 

Proof. Since x is factorable, there exists a non-empty set of fiuents S such that x spans 
over S, i.e. there exists if such that (pi = ip A ipi where ipi € BIN{S) for i = 1, . . . , n and 
BIN{S) = {ipi, . . . ,tljn}. Assume that S is not unique. This means that there exists a 
non-empty set S' ^ S such that x spans over S' , i.e. there exists if' such that (pi = ip' A ip'^ 
where ip'^ G BIN{S') for i = 1, . . . , n. 

Consider / € S \ S". For every 1 < i < n, we have that ipi = ip' A ip'^. Since f ^ S' and ipi is 
consistent <i <n), f must occur either positively or negatively in ip' . This means that 
/ occurs either positively or negatively in all ipi for 1 <i <n. 
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Consider the case that / occurs positively in all ^pi for 1 < i < n [*]. Since f £ S, there 
exists a binary representation ipj € BIN{S) (1 < j < n) such that / appears negatively 
in ijjj i.e. / appears negatively in ipj. This contradicts with [*]. Similarly we can show a 
contradiction in the case that / occurs negatively in all (fi for 1 < i < n. We conclude that 
S is unique. □ 

Lemma 4.19. Let a be an a-state, (5 be a p-state, and c = ai;...;a„ (n > 1) be a 
sequence of non-sensing actions. Assume that c is regressable with respect to {a, 5). Then, 
Tl*{an, 6) = 6' , 6' and c' = oi; . . . ; a„_i is regressable with respect to {a, 5'). 

Proof. By induction on n. 

• Base Case: n = 1. Similar to the inductive step, we can show that ai is applicable in 
5. Let 6' = n{ai,6) and <^{ai,a) = {a'}. We have that, 6'.T = {6.T \ Adda^) U Pre+ 
and cj'.T = [a.T \ Dela^) U Adda^. Using the facts a' G ext{6), Adda^ PI Dela^ = 0, and 
the above equations, we can show that 6'.T C a.T. Similarly, 5' .F C a.F. Since [ ] is 
not redundant with respect to {a, 6'), we have that [ ] is a plan that is regressable with 
respect to (a, S'). 

• Inductive Step: Assume that we have proved the lemma for < n < A;. We need to prove 
the lemma for n = k -\- 1. 

Let ^*{ai; . . . ; a^, cr) = {a^}, we have that 

$*(c,a) = $(afc+i,(Tfc) = {a'} C ext{6). 

We will prove that (1) Ok+i is applicable in 6, (2) TZ{ak+i,6) = (5* / _L and ak G ext(6*), 
and (3) c' = ai; . . . ; ak is regressable with respect to {a, 5*). 

- Proof of (1): We first show that ^^4^+1 n (5.T / or Dela^^j n 5.F / 0. Assume the 
contrary, Adda,.^^ H 6.T = and Dela/.^^ H 5.F = 0. By Definition 12.41 we have that 

a'.T = {ak-T \ Dela^^j) U Adda,^^-, 

and 

a'.F = {ak.F\Adda,^,)UDela^^^. 
Since a' € ext{5), we have 5.T C a'.T. By our assumption, Adda,.^^ H 5.T = 0, we 
must have that 6.T = 5.T \ Adda,^^-^ ^ cr'.T \ Adda^^^ . Because for arbitrary sets X, Y, 
{XUY)\Y = X\{Xr\Y),we have that 

cr'.T \ ^ddafc+i = {{(^k-T \ Dela^^-^) U Addafe+i) \ = 

K.T \ I)eZa,+ J \ ((fTfc.T \ Dela,^,) D Adda,^,) C a^.T, 
i.e. (5.T C fjfc.T \ Dela^.^^. This shows that 5.T C ak.T. Similarly, we can show that 
5.F C (Tfc.F. We conclude that Ufe G ea;t((5), i.e. c is redundant with respect to {a-, 5). 
This is a contradiction. Therefore, Adda^^^ n J.T / or Dela^_^_^ n (5.F / 0. (i) 
Since a' G ej;t((5), we have S.T C a'.r and C u'.F. As a^+i is executable in ak, we 
have Addaf.,^,^ Cia'.F = and Dela,.^^ Ha'.T = 0. This concludes that Adda,^^-^ r\6.F = 
and -DeZa^+i ^ (5.r = 0. (ii) 
Now, assume that there exists / G Pf^a^ ^ H 8.F and / Dela^^^- By Definition 
12. 4( it's easy to see that / G a' .T and / G a' .F. This is a contradiction, therefore 
-^'^^Ofe+i 1^ ^ P'^lak+i- Similarly, we can show that Pre~^^_^ fl 5.T C Adda,,^^^. (iii). 
From (i), (ii), and (iii) we conclude that ak+i is applicable in 6. 
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- Proof of (2): Because ak+i is applicable in 6, we have that Tl{ak+i,S) = 6* for some 
partial state 6* ^ _L. We will show that cr^ € ext{6*). From the fact a' € ext{6), by 
Definition 12.41 we have 

6.T C a'.T = {ak.T \ Dela,^^) U Adda,+, 

and 

5.F C a'.F = [au-F \ Adda,^,) U DeL^^^. 
By Definition 13.21 we have 

5\T={5.T\Adda,^,)lJPret^^^ 

and 

5\F = {5.F\Dela,^,)^Pre-^^^. 
Since a^+i is executable in cjfc, we have that Pre^^^^ C cr^.T and Pre~^^^ C cr^.F. 
Therefore, to prove that 5* .T = {6.T \ Adda,.^-^) U Pre'^^^_^ C cjfc.T, we only need to 
show that 6.T \ Addaf.j^_^ ^ fj^.T. As 5.T C {ai^.T \ Dela,,^^) U j4cidaj.^j , we have 

5.T \ Adda,^, C {{ak.T \ Dela,^^) U Adda,^,) \ Adda,^,. 

From the proof of item (1), we have that {{ak-T\Dela^_^_^)^ Adda,,^-^^)\Adda|^^^ C cr^.T. 
This concludes that 6.T\Adda,.^^ ^ a^.T. Similarly, we can show that S.F\Dela^^^ C 
iTfc.F, i.e., (Tfc € ext((5*) or {cJfc} C ext{5*). 

- Proof of (3): Suppose that c' is redundant with respect to {a, 5*). By Definition 14.121 
there exists a subplan c" of c such that $*(c",cr) = {o""} C ext{5*). By Theorem 14.21 
we have that ^{ak+i, cr") C ext((5). Since 

$*(c";afc+i,cj) = ^>(afc+i,o-") C ext{6), 

we have that c is redundant with respect to {a, 6) . This contradicts with the assumption 
that c is not redundant with respect to {a, 6). Since c' has no case plan, this concludes 
that c' is not redundant with respect to {a, 6*). Since ^*{ai] . . . ; a^, a) = {cTk} ^ ext{6*) 
we have that c' is regressable with respect to {a, 6*). □ 

Lemma 4.20. Let a be an a-state and 5 be a p-state. Let c = ai; . . . ; a„ be a sequence 
of non-sensing actions that is regressable with respect to {(7,6). Then, there exists some 
p-state (5* / _L such that TZ*{c, 6) = 6* and a e ext{5*). 

Proof. By induction on n. 

• Base Case: n = 0. Then c is an empty sequence of non-sensing actions. The base case 
follows from Definition 13.171 fwith 6* = 5 and [ ] is not redundant with respect to {a, 5)). 

• Inductive Step: Assume that we have proved the lemma for < n < A:. We need to 
prove the lemma for n = k + 1. It follows from Lemma 14.191 that 6' = TZ{ak+i, S), 6' ^ _L, 
and c' = ai;...;afc is a plan that is regressable with respect to {cr,5'). By inductive 
hypothesis, we have that TZ*{c' , 6') = 5* ^ J- and a € ext{5*). The inductive step follows 
from this and the fact 7^*(c, 6) = n*{c\ TZ{ak+i,S)). □ 
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Lemma 4.21. Let a be an a-state, a be a sensing action which is executable in a. Let 
Sa = Sensa \ cr. Then, we have that 

(1) ^{a,a) = {ai, . . . ,crm} where m = 2'*^'^l, 

(2) a is strongly applicable in A = {5i, . . . ,5m} where 6i = [cTj.T, cTj.-F], i = 1, . . . , m, and 

(3) 7^(a,A) = [a.T,a.F]. 

Proof. 

(1) From Definition 12.41 we have that 

-L ^ <I>(a, a) = {a'\SenSa \ a = a' \ a} 

and, for every a' G $(a, a), a' \ cj = (cr'.T \ cj-T) U (cj'.F \ a.F). Denote a'.T \ a.T by 
P and cj'.-F \ a.F by Q, we have that (P, Q) is a partition of 5a. Since there are 2^^°-^ 
partitions of Sa, we have that m < 2^^'^^. Furthermore, for a partition (P, Q) of there 
exists an a-state u' = (P U a.T, Q U cr.P) € <l>(a, ex) because a' \ cr = P U Q. Therefore 
2l'S'a| < yi^Q conclude that m = 21"^"!. 

(2) We first show that A is proper with respect to Sa, i.e. Sa is a sensed set of A with 
respect to a. Indeed, by Definition 12.41 and the proof of (1), we have that the first 
three conditions of Definition 13.61 are satisfied. The fourth condition of Definition 13.61 is 
satisfied because we have that 5i.T\Sa = ai.T\Sa = a.T and 5i.F\Sa = ai.F\Sa = a.F 
(1 < 2 < m). Therefore, we conclude that p{a. A) = Sa. 

Since a is an action that is executable in a we have that (Pre^ U Pre^ ) n Sens a = 
and Pre+ n a.F = 0, Pre" n a.T = 0, therefore Pre+ f^ 5i.F = 0, Pre" n ^i.T = 
(1 < i < m). By Definition 13.81 we conclude that a is strongly applicable in A. 

(3) Since a is executable in a, we have that PrCa ^ a.T and PrCa C a.F. From the proof 
of (2), 5i.T \ Sa = a.T and 6i.F \ Sa = a.F {1 < i < m). The proof follows from 
Definition rrfel □ 

Lemma 4.22. Let a be an a-state, 6 he a p-state, and c = a; c' is a conditional plan where 
a is a non-empty sequence of non-sensing actions and c' = a; case[(pi — > pi, . . . , (pm — »■ Pm)- 
If c is regressable with respect to {a, 5), then 

(1) there exists some a-state cri / _L such that (^*{a,a) = {ai}; 

(2) m = 2^^°-^ where Sa = SenSa \ ai; 

(3) {Lpi,...,ipm} spans over Sa] 

(4) For each i, 1 < i < m, there exists a unique a-state a' G $(a,cJi) such that pi is 
regressable with respect to {a', 6). 

Proof. 

(1) By Definition 12.61 we have that 

^%c,a)= U ^*ic',a'). 

Since c is regressable with respect to {a, 5) we have that _L ^ $*(c, cr). This implies 
that _L ^ <I>*(a,cr). Furthermore, because a is a sequence of non-sensing actions, we 
conclude that there exists some a-state ai ^ _L. such that <I>*(a,cr) = {ai}. 

(2) By definition of Sa we conclude that Sa is the set of fluents that belong to SenSa 
which are unknown in ai. By Definition 12. 4| we conclude that $(a, cri) consists of 21"^" 
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elements where for each a' e <I>(a, o"i), a' \ai = Sa- Because 

-L0$*(c,cr)= [J E{case{Lpi^pi,...,iprn^Pm)-,(y') 

CT'G'I>(a,(7i) 

we conclude that for each a' S <5(a, cJi) there exists one j, 1 < j < m, such that is 
satisfied in a' . Since ip^s are mutual exclusive we conclude that for each j, 1 < j < m, 
there exists at most one a' € ^{a,ai) such that cpj is satisfied in a'. This implies that 
m > 21^'" I. The non-redundancy property of c implies that m > 2^^'^^. Thus, m = 2l'^°L 

(3) Since c is regressable with respect to {a, 5) we have that a; {case{ipi pi, . . . , — > Pm) 
is potentially regressable. This implies that {ipi, . . . ,ipm] spans over a set of fiuents 
S C Sensa and there exists a if such that for every i, ipi = tpi A where ipi £ BIN{S) 
and S n {(p~^ U ip~) = 0. From Lemma 14.181 we know that S is unique. We will show 
now that S = Sa- Assume the contrary, S ^ Sa- We consider two cases: 

• 5 \ 5a 7^ 0. Consider a fiuent / G 5 \ Sa- Because {ipi, . . . , ipm} spans over S, there 
exists some i such that / occurs positively in ipi. From the proof of the previous 
item and the fact that f ^ Sa, we conclude that / must be true in ai (otherwise, 
we have that the subplan c' of c, obtained by removing the branch ipi ^ Pi, satisfies 
-L ^ $*(c',c7) C ext{5), which implies that c is redundant with respect to (a, 5)). 
Similarly, there exists some j such that / occurs negatively in ipj, and hence, / must 
be false in ai. This is a contradiction. Thus, this case cannot happen. 

• Sa \ S ^ ^. Consider a fluent f € Sa \ S. Again, from the fact that c is regressable 
with respect to {a, 5), we conclude that / occurs either positively or negatively in 
ifi- Because f ^ S, we have that / occurs in ip, and hence, / occurs positively or 
negatively in all ipi- In other words, / is true or false in every a' G <l>(a, cji). Thus, / 
is true or false in ai. This contradicts the fact that f ^ Sa = SenSa \ cfi- Thus, this 
case cannot happen too. 

The above two cases imply that Sa = S. This means that {(fi, . . . , ipm} spans over Sa- 

(4) Consider an arbitrary i, 1 < i < ni- From the proof of the second item, we know 
that there exists a unique a' £ <I>(a,cJi) such that cpi is satisfied by a'. We will show 
now that pi is regressable with respect to {a', 5). From the fact that c is regressable, 
we conclude that every case plan in pi is potentially regressable. Furthermore, because 
^*{pi, a') C $*(c, o"), we have that _L ^ ^*{pi-, cr') C ext{5). Thus, to complete the proof, 
we need to show that pi is not redundant with respect to {a', 5). Assume the contrary, 
there exists a subplan p' oi pi such that ± <I>*(p',cj') C ext{5). This implies that the 
subplan d of c, obtained by replacing pi with p' , will satisfy that ± <I>*(c', cr) C ext{5), 
i.e., c is redundant with respect to (cr, (5). This contradicts the condition of the lemma, 
i.e., our assumption is incorrect. Thus, pi is not redundant with respect to (cr',(5), and 
hence, pi is regressable with respect to {a' , 5). □ 

Lemma 4.23. Let a be an a-state, (5 be a p-state, and c is a conditional plan that is regress- 
able with respect to {a, 5). Then, there exists some p-state 5' ^ 1. such that 'R*{c,5) = 5' 
and fj € ext{5'). 

Proof- By induction on count{c), the number of case plans in c. 

• Base Case: count{c) = 0. Then c is a sequence of non-sensing actions. The base case 
follows from Lemma 14.201 

• Inductive Step: Assume that we have proved the lemma for count{c) < k- We need 
to prove the lemma for count{c) = k + 1. Since c is a conditional plan, we have that 
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c = a; c' where a is a sequence of non-sensing actions and c' = a;p and p = case {ipi — > 
pi, . . . , ifrn Pm)- Because a is a sequence of non-sensing actions we have that $*(a, cr) 
is a singleton. Let <I>*(a, cr) = {(Ji}. 

Let Sa = Sens a \ o'l ■ Since c is not redundant with respect to (cj, 5) we conclude that 

It follows from the fact that c is regressable with respect to {cr,6) and Lemma 14.221 that 
{ifi, . . . , ipm} spans over Sa and for every i, 1 < i < m, there exists a unique a' £ <I>(a, cJi) 
such that Pi is regressable with respect to {a', 6). By inductive hypothesis for pi, we 
conclude that TZ*{pi,6) = 6i J- and cr' G e3;t((5i). Because (/jj is satisfied by a' we have 
that R{ipi Pi,S) = [6i.T U ipf,6i.F U c/j.^'] is consistent and hence R{ipi — > Pi,S) ^ _L. 
This also implies that cr' € ext{R{ifi Pi,S)) and —>■ Pi,6) 7^ ~* Pj^^) for 

^ 7^ J- 

Let A = ^ Pi, I i = 1, • • • ,"^}- We will show next that a is applicable in A. 

Consider A' = <I>(a, cxi), we have that for each i, 1 < i < m, there exists one cr' G A' and 
ct' G ext{R{ipi — > pi,S)). It follows from Lemma 14.211 that a is strongly applicable in A'. 
Thus, a is applicable in A. 
By definition of TZ, we have that 

7^(a, A) = [((U:^i R{V>^ - 5).T) \ Sa) U Pre+, 

((UIli Ri^^ - P., \ Sa) U Pre-] = 5 V ^- 
Since a is executable in a"i, from Lemma 14.211 and the fact that for each cr' G <I>(a,cri) 
there exists an i such that a' G ext{R(ipi — > we can conclude cri G ext{6*). 

To continue our proof, we will now show that q = a is not redundant with respect to 
(cT, 6*). Assume the contrary, there exists a subplan q' of q such that ^*{q', cr) C ext{6*). 
This, together with the fact that TZ*{c',S) = 6* and Theorem l4.8l imDlies that <I>*(c",cr) C 
ext{S) for c" = q';c', i.e., c is redundant with respect to (cr, 5). This contradicts the 
assumption of the lemma, i.e., we have proved that q is not redundant with respect to 

(CT,<5*). 

Applying the inductive hypothesis for the plan q and {a, 6*), we have that Tl*{q,6*) = 
6' J- and cr G ext{6'). The inductive hypothesis is proved because Tl*{c,6) = Tl*{q,6*). 

□ 

Lemma 4.24. Let cr be an a-state, 5 be a p-state, and c be a sequence of non-sensing actions 
such that ^*{c, a) C ext(5). Then, there exists a subplan c' of c that is not redundant with 
respect to (cr, 5) and c' is equivalent to c with respect to {cr,S). 

Proof. Notice that the length of c is finite^. Consider two cases: 

• Case (i): c is not redundant with respect to {a, 6). 

It's easy to see that c' = c satisfies the condition of the lemma. 

• Case (ii): c is redundant with respect to {a, 5). 

By definition of redundancy, there exists a subplan of c which are equivalent to c with 
respect to {cr,6). Let c' be a subplan of c which is equivalent to c with respect to (cr, 5) 
whose length is minimal among all subplans which is equivalent to c with respect to (cr, 5) . 
To prove the lemma, it suffices to show that c' is not redundant with respect to (cr, 5). 
Assume the contrary, there exists a subplan c" of c' which is equivalent to c with respect 



'By this we mean that c is given and hence its length (the number of actions in c) is finite. 
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to {a, 6). Trivially, the number of actions in c" is smaller than the number of actions in c'. 
By definition, we have that c" is also a subplan of c which is equivalent to c with respect 
to ((T, 6). This contradicts the fact that c' has the minimal length among all subplans of c 
which are equivalent to c. So, we conclude that c' is not redundant with respect to (a, 5). 
The lemma is proved. □ 

Lemma 4.25. Let a be an a-state and c = a; case {cpi — > pi, . . . , ip^ Pm) be a case plan 
such that _L ^ ^*{c,a). Then, if Sensa \ cr 7^ 0, there exists a potentially regressable plan 
c' = a; case {ip[ p[, . . . ,ip'n p'^) such that $*(c, a) = <^*(c',cj). 

Proof. We prove the lemma by constructing c' . Let S = {(pi, . . . , (^^m} and 5a = Sens a \ o. 
Let = {/ I / € S'a} U {-1/ [ / G S'a}. First, observe that because of _L *l'*(c, a) we have 
that a is executable in a. Furthermore, for each a' G $(a,o") there exists one (pi ^ S such 
that ifi is satisfied in a' . Without loss of generality, we can assume that for each ipi € S, 
there exists (at least) one a' E $(a, cr) such that ipi is satisfied in a' . 

It is easy to see that for each i, we can write ipi = ipi A Xi where V'j is the conjunction 
of literals occurring in ipi and belonging to L and Xi is the conjunction of literals that 
do not belong to L. From the above observation, we have that Xi is satisfied by a. So, 
if = /\^iXi holds in a. Thus, the conditional plan ci = a; case {ip'i — > pi, . . . , ip'^ —>■ pm) 
where tp'^ = tpi A ip satisfies that $*(c, a) = $*(ci,cj). 

Since ipi is a consistent conjunction of literals from L and 'i/'i's are mutual exclusive, there 
exists a partition {Si, . . . , 5^) of BIN{Sa) such that for every rj & Si, rj = ipi A rj' . Let 

C2 = a; case{ 





■^Pl,.. 


..7P'- 






■^Pl,.. 




■^P2, 




-^Pl,- 


• • 1 fm 





) 

where 

7i = A A 7 

5j = {?7j^, . . . , ??|'^''} for z = 1, . . . , m, and 

7 = /\ /GSenSaHo-.T / /\ /e5ens„n<T.F • 

1 5 I 

We have that $*(c, a) = <I>*(c2,ct). It is easy to see that the set {7}, . . . ,7m'" } spans over 
Sa and SenSa C (7^)"'" U {'yj)~ ■ Thus, C2 is potentially regressable. The lemma is proved 
with c' = C2- □ 

Lemma 4.26. Let a be an a-state, let 5 be a p-state, and let c be a conditional plan such 
that $*(c, cr) C ext{S). There exists a plan c' such that c' is regressable with respect to 
{a, 5) and c' is equivalent to c with respect to {a, 5). 

Proof. By induction on count{c), the number of case plans in c. 

• Base case: count{c) = 

This follows from Lemma 14.241 
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• Inductive Step: Assume that we have proved the lemma for count (c) < k. We need to 
prove the lemma for count (c) = k + 1. 
By construction of c, we have two cases 

(1) c = a;p where p = case {ipi — > pi, . . . , ipm Pm)- Here, we have two cases. 

(a) Sensa \ cr = 0. In this case, we have that there exists some j such that ipj is 
satisfied by a and <I>*(c, cr) = ^*{pj,a). Thus, c is equivalent to pj with respect 
to (cr, S). Since count{pj) < count{c), by the inductive hypothesis and transitivity 
of the equivalence relation, we conclude that there exists a plan c' such that c' is 
regressable with respect to {a, 5) and c' is equivalent to c with respect to {a, 6). 

(b) SenSa \ cr 7^ 0. Without loss of generality, we can assume that for each ipi G S, 
there exists (at least) one a' £ $(a, a) such that ipi is satisfied in a'. Using 
Lemma [4.251 we can construct a plan ci = a; case {ip'i — > p'^, . . . ,ip'^ —i- p'^) which 
is potentially regressable and $*(ci,cr) = <I>*(c, cr). From the construction of ci, 
we know that for each a' G $(a, cr) there exists one and only one j, 1 < j < n, 
such that ip'j is satisfied in a'. Applying the inductive hypothesis for (cr', 5) and 
the plan p'-, we know that there exists a regressable plan qi which is equivalent 
to p'^ with respect to (cr', 6). This implies that c' = a; case (y?'^ —i- qi, . . . , (^^ —i- 
Qn) is equivalent to c with respect to (cr, 5). Furthermore, every case plan in c' 
is potentially regressable and each qi is regressable with respect to {cr',S). To 
complete the proof, we will show that c' is not redundant with respect to (cr, 5). 
Because for each cr' E <I>(a, cr) there exists at most one j such that (^^- is satisfied 
in a' , none of the branches can be removed. Since SenSa \ cr 7^ there are 
more than one a-state in $(0, cr). Therefore, we cannot replace c' by one of its 
branches. This, together with the fact that qj is not redundant with respect 
to (cr',(5), implies that c' is not redundant with respect to (cr, 5). The inductive 
hypothesis is proved for this case as well. 

(2) c = a; ci where a is a sequence of non-sensing actions and ci is a case plan. Let 
Pa = {a' I a' is a subplan of a and there exists some c'/ such that a'; c'/ is equivalent 
to c with respect to {a, 5)}. Let /? be a member of Pa such that \j3\ = min{|a'| | a' G 
PaY . Since Pq, / 0, /5 exists. We have that /? is a sequence of non-sensing actions, 
and so, <I>*(/3, cr) = {cri}. It follows from the above case and the inductive hypothesis 
that there exists a regressable plan c'^ which is equivalent to ci with respect to (cri, (5). 
Consider the plan c' = /3;c'^. We have that c' is a potentially regressable conditional 
plan. To complete the proof, we will show that c' is not redundant with respect to 
(cr, 5). Assume the contrary, we will have three cases: 

(a) There exists a subplan (3' of (3 such that q = j3'; c'^ is equivalent to c' with respect 
to (cr, 5). This implies that /3'; ci is equivalent to c' with respect to {a,S) which 
contradicts the construction of f3. 

(b) There exists a subplan c" of c'^ such that q = (5; c" is equivalent to c' with respect 
to {(7,5). This implies that c" is equivalent to c'^ with respect to {cri,S) which 
contradicts the construction of c'^. 

(c) There exists a subplan /3' of /? and a subplan c" of c[ such that q = f3'; c" is 
equivalent to c' with respect to (cr, 5). This implies that /?' S Pa and \(3'\ < \f3\, 
which is a contradiction on the construction of /3. Thus this case cannot happen 
as well. 



For a sequence of actions 7, I7I denotes the length of 7. 



30 



L.-C. TUAN, C. BARAL, AND T. C. SON 



This shows that d is not redundant with respect to (a, S). So, we have proved that c' 
is regressable and equivalent to c with respect to (cr, S). The inductive step is proved 
for this case. □ 

We are now ready to prove the completeness of our regression formulation, which is 
illustrated by Figure |S1 

Theorem 4.27 (Completeness of Regression). Given a planning problem P = {A, O, I, G) 
and a progression solution c of P, there exists a regression solution c' of P such that c' is 
not redundant and is equivalent to c with respect to (a/, 5g)- 



Progression 

ai ^ <3?*(c,cr/)Cea;t(5G) 

**(c,o-/) 
c 

t 

I Equivalent w.r.t. {(Ji,5g) 



T 

C' 

■R.'{c\Sg) 

S^L,ai&ext{S)^ — — — — — — — — — (5(3 

Regression 

Figure 5: Illustration of Theorem 14.271 



Proof. Lemma 14.261 implies that there exists a regressable plan c' with respect to ((T/,(5g) 
which is equivalent to c with respect to (ct/,^^). The non-redundancy of c' follows from 
the fact that it is a regressable plan. The conclusion of the theorem follows directly from 
Lemma 14.231 and Theorem 14.81 □ 



5. Related Work 

Waldinger [2S1 is probably the first to discuss regression in Artificial Intelligence. In his 
paper, Waldinger uses the concept of regression in plan modification. To plan for several 
goals simultaneously, say P and Q, his strategy was to first find a plan to achieve P, then 
modify that plan to achieve Q. In order to achieve Q, regression is used to make sure that 
any action added to the existing plan will not interfere with P. Waldinger's regression is 
based on the idea of "weakest precondition" proposed by Dijkstra in 1975 |Hl(see also, e.g., 
OEj). Intuitively, regression from a logical sentence that is represented by a conjunction 
of goals, conj, via an action, yl, yields another logical sentence that encodes what must be 
true before A is performed to make conj true immediately afterwards. This is computed 
by the formula 

S' = Prec{A) U {S\Add{A)), 
where S denotes the set of goals in the conjunction conj., S' denotes subgoals in the regressed 
conjunction, Pre{A) denotes the set of preconditions of ^, and Add{A) denotes the set of 
add conditions of A] something similar to what is proposed in [201 ■ Following Waldinger, 
Nilsson (1^ discusses regression with respect to partially grounded actions and proposes a 
regression algorithm for plan generation. 

Another early effort in formulating regression over simple (non-sensing) actions is due 
to Pednault H^. In his Ph.D. thesis JHI) Pednault proposed the language ADL (Action 
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Description Language) that extends STRIPS and allows, amongst other things, conditional 
effects. In addition, Pednault also presents sound and complete formula-based regression 
operators for ADL actions. Addressing a similar problem, Reiter [TH] also presents a sound 
and complete formula-based regression formulation over simple actions within the Situation 
Calculus framework. It reduces reasoning about future situations to reasoning about the 
initial situation using first-order theorem proving. Regression operators are provided for 
the formulae, with and without functional fluents. 

Scherl and Levesque |19j were probably the first to extend the regression formulation 
for simple actions to include sensing actions. They directly formalize regression in first 
order logic, within the framework of Situation Calculus. Their formula-based regression 
operator is defined with respect to a set of successor state axioms which was based on 
Moore's formulation of accessible worlds They show that, for any plan P expressed 

by a ground situation term Sgr (a ground situation term is built on the initial situation by 
repeatedly applying the function do on it), the axiomatization of a domain including the 
successor state axioms Fgg, G is an arbitrary sentence then 

where R*{^) indicates that the regression operator is repeatedly applied until the regressed 
formulae is unchanged. Intuitively, this shows that the regression is sound and complete. 
However, Scherl and Levesque do not define regression over conditional plans. Later, Reiter 
adapts the work of Scherl and Levesque in his book ^Sl- He does not, however, consider 
regression on conditional plans. De Giacomo and Levesque |2] consider a generalized action 
theory where successor state axioms and sensing information are conditionally applicable. 
For example the following conditional successor state axiom [H] expresses that if a robot is 
alone in a building, then the status of the door is only defined by the robot's actions open 
and close. 

Alone{s) D 

DoorOpen{x, do{a, s) = 

a = open{x) V (a 7^ close{x) A DoorOpen{x, s)). 

Here the sensor fluent formula Alone{s) expresses the condition that the robot is alone 
in the building in a situation s, DoorOpen{x, do{a, s) expresses the fact that a door x is open 
in the situation after the robot performs an action in the situation s, and DoorOpen{x, s) 
expresses the fact the door x is open in the situation s. Similarly, the following conditional 
sensed fluent axiom ^ expresses the condition that if the robot is outdoors, then its on- 
board thermometer always measures the temperature around the robot. 

Outdoor{s) D 

OutDoorTemperature{n, s) = thermometer (s) = n. 

Their formula-based regression is then defined over histories. A history is defined as a 
sequence {vq).{Ai, fi), . . . , {An, Vn) where each Ai is an action, Vi represents a vector of the 
values {vi^i, . . . , Vi^m) and Vij represents the reading value of sensor after the i*'* action. 
However, they showed that the regression although sound, does not guarantee completeness 
in some circumstances. They also did not consider regression on conditional plans. 

In another direction. Son and Baral ,20^ study regression over sensing actions using the 
high-level action language Ak- In this work, they provide a state-based transition function 
and a formula-based regression function with respect to the full semantics. Different from 
the work of IHIE], Son and Baral define regression over conditional plans. They also prove 
that their regression formulation is both sound and complete with respect to the transition 
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function. However in ^}^, Son and Baral do not consider precondition of actions in their 
regression formulation. 

The regression formahsm presented in this paper differs from earher notion of regression 
for action theories with sensing actions in jl8l 1191 l?Oi| in that our definition is a state- 
based regression formahsm while the earlier definitions are formula-based. With regards 
to regression on conditional plans, we are not aware of any other work except [^Oj. For 
regression on non-sensing actions, our definition is close to the formula used in 

6. Conclusion, Discussion, and Future Work 

In this paper, we developed a state-based regression function in domains with sensing 
actions, incomplete information, and actions without conditional effects. We also extended 
the regression function to allow for the regression over conditional plans. We proved the 
soundness of the extended regression function with respect to the definition of the progres- 
sion function and developed a relaxed notion of completeness for the regression function. 

It is interesting to note that for planning problems described in this paper, the progres- 
sion function developed in this paper is equivalent to the full semantics for domains with 
sensing actions and incomplete information and to the 0-approximation developed in [20^. 
This implies that the regression function TZ (and hence TZ*) is also complete with respect to 
the full semantics for planning problems as defined in Section f2. II Since the complexity of 
(conditional) planning with respect to the 0-approximation is lower than that with respect 
to the full semantics of sensing actions, this means that the conditional planning problem 
for domains presented in this paper has a lower complexity than it is in general. In other 
words, the complexity of the conditional planning problem presented in this paper in NP- 
complete, whereas the complexity of the conditional planning problem for action theories 
with conditional effects is Sp-complete pp. We observe that this complexity results are 
somewhat different than the complexity results in [H], as the planning problems in [H] do 
not contain sensing actions and are complete. 

It should be noted that the notion of a conditional plan in this paper is not as general 
as in 20 . For example, we do not consider plans of the form ci; C2 where ci and C2 are case 
plans. This is done to make the presentation of the proofs easier to follow. Indeed, in |22j . 
we proved that all of the theorems in this paper are valid with respect to conditional plans 
defined in 

Finally, we would like to mention that we have developed a regression-based planner, 
called CPR, using the regression formulation proposed in this paper [231 • The planner 
employs the best first search strategy with a heuristic function similar to the HSP-r heuristic 
function |^. Due to the fact that most of the available benchmarks in planning with 
sensing actions allow disjunction in the initial state and conditional effects, an experimental 
evaluation of CPR against other planners could not be done with respect to the benchmarks. 
We have therefore developed our own domains to test CPR. Our initial experimental result 
shows that CPR performs reasonably well |23j . The code of CPR and the domains are 
available at http://www.cs.nmsu.edu/~tson/CPR, 

Our main goal in the near future is to extend the regression formalism proposed in 
this paper to allow conditional effects and disjunctive initial states. This will allow us to 
extend CPR to deal with conditional effects and to evaluate the planning approach based 
on regression against forward chaining approaches. 
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